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Abstract 



A recent result, relating the (irreversible) work performed on a system during 
a non-quasistatic process, to the Helmholtz free energy difference between two 
equilibrium states of the system, is discussed. A proof of this result is given 
for the special case when the evolution of the system in question is modelled 
by a Langevin equation in configuration space. 
My purpose in this talk is to present and discuss a result which relates the free energy 
difference between two equilibrium states of a system — defined with respect to two values of 
an external parameter — to the work performed on the system by changing that parameter 
at a finite rate from one value to the other. 

Let me begin with a fundamental statement from classical thermodynamics |]]] : the total 
work performed on a system during an isothermal, quasistatic process is equal to the free 
energy difference between the initial and final equilibrium states of the system.^ This state- 
ment may be understood as follows. Imagine a finite system which depends on some external 
parameter, A. Macroscopically, an equilibrium state is the unique state attained by the sys- 
tem by allowing it to come to equilibrium with an infinite heat reservoir at temperature T, 
holding A fixed. Such a state may be represented by a single point in the (A, T)-plane, as 
shown in Fig]]]. With each equilibrium state we may associate a free energy F: 

F(\,T) = E-ST, (1) 

where E and S denote, respectively, the internal energy and the entropy of the system, both 
functions of the state. If we now prepare the system in a state (A^T), and then infinitely 
slowly change the value of A from A^ to As, always keeping the system thermostatted (i.e. 
in contact with the heat reservoir) at temperature T, then the system will evolve through 
a continuous sequence of equilibrium states — represented by the dotted line in Fig.|l| - 



*Talk presented during the Marian Smoluchowski Symposium on Statistical Physics in Zakopane, 
Poland, September 1-10, 1997. 

1 Throughout this talk, the term "free energy" will refer specifically to the Helmoltz free energy. 
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and the net external work which we perform during this process will equal the free energy 
difference between the initial and final states: 

W OQ = AF = F(X B , T) - F(X A , T). (2) 

The subscript on W reminds us that this process is carried out quasistatically. 

At the microscopic level, we must treat the system statistically, replacing the unique 
macroscopic state by a probability distribution (or ensemble) of micro-states of the system. 
An equilibrium state of the sort discussed in the previous paragraph is represented by a 
canonical ensemble in the microscopic phase space, and the free energy is given by 

F(X,T) = —k B T\nZ(X,T), (3) 

where Z denotes the partition function. During a process in which the system remains 
thermostatted while A is varied quasistatically from Xa to X B , the statistical state of the 
system evolves through a continuous sequence of canonical ensembles, and again the work 
performed is equal to the free energy difference between initial and final equilibrium states: 
W OQ = AF. 

Eq.^ is thus a basic statement from both macroscopic thermodynamics and microscopic 
statistical mechanics. The central point which I wish to make is that there exists a com- 
parably simple result, which relates AF (defined as the free energy difference between two 
equilibrium states A and B) to the work performed during a process in which A is changed 
from Xa to X B at a finite rate; hence, a nonequilibrium, irreversible process. 

Consider therefore the following sequence of steps. (1) With A fixed at an initial value 
(Xa), we let the system equilibrate with a reservoir at temperature T. (2) We then externally 
"switch" A from the initial value (A^) to a final one (X B ) over a finite time r. (For specificity, 
assume A = dX/dt to be constant.) The system remains in contact with the reservoir as 
we switch A. (3) Once A reaches its destination (X B ), we note down the external work W 
which we performed on the system during this process. (4) Go back to step 1 and repeat 
ad infinitum. Steps 1-3 define what I will call a single realization of the switching process; 
by virtue of step 4, we obtain a statistical ensemble of such realizations. Note that although 
the system begins in equilibrium with the reservoir, it does not generally remain so once we 
start changing A at a finite rate. Typically, the system will be found in a nonequilibrium 
state, not characterized by a single point (A, T) (though the value of A is of course well 
defined at every instant). Schematically, I have depicted this situation by representing the 
evolution of the system as a shaded area, see Fig.^|, rather than as a single line as in Fig.[TJ. 

(At the end of the switching process, we can of course always opt to hold the value of 
A fixed, at X B , and allow the system to relax to equilibrium with the reservoir, in this way 
finally attaining the equilibrium state B. This then gives us a prescription for going from 
one equilibrium state, A, to another, B, via a nonequilibrium process. However, once we 
stop changing the external parameter A, we stop performing external work on the system. 
Therefore the central result to be presented below, which makes a statement about the work 
W performed externally, is independent of whether or not we carry out the supplementary 
step of allowing the system to relax to state B at the end of the switching process.) 

Since the switching described in step 2 above is carried out at a finite rate, we expect 
statistical fluctuations: the work W will differ from one realization to the next. Thus, having 
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obtained a statistical ensemble of realizations by repeating steps 1-3 ad nauseum, we will 
have a distribution of values of work, p(W), defined such that p(W)dW gives the proportion 
of realizations for which the work fell within an infinitesimal window dW around a particular 
value W . 

The distribution p{W) will depend on how slowly or quickly the switching was performed, 
that is, on the switching time r. (In carrying out steps 1-4 above, it was assumed that 
r remained the same from one realization to the next.) For r — > oo, we get p(W) — > 
5(W — AF), by Eq|| whereas for r finite we expect the distribution p{W) to have a finite 
width. Generically, the faster we switch A, the larger the expected fluctuations in W , as 
depicted in Fig.|. 

One final point before I reach the punch line. While W = AF in the quasistatic, 
reversible limit (r — > oo), for finite switching times we expect the work performed to exceed 
the free energy difference AF: 

W > AF, (4) 

where the overbar denotes an average over our statistical ensemble of realizations of the 
switching process, carried out at a fixed value of r. (This statement does not preclude an 
occasional measurement of W which falls below AF, though for macroscopic systems such 
fluctuations will be exceedingly rare.) The inequality given by Eq.|] essentially follows from 
the Second Law: the work performed during an irreversible process is expected to exceed 
that performed during the corresponding reversible process. 

Let me now make a claim which is the central focus of this talk. If instead of taking 
the average of the work W, over a statistical ensemble of switching realizations, we take the 
average of the quantity e~^ w , where (3 = 1/fcgT, then that average will be equal to e~^ AF , 
for any value of the switching time r: 

exp -/3W = J dW p(W, t) exp -(3W = exp —(3AF , for all r. (5) 

(The dependence of p{W) on the switching time r has been made explicit here.) That is, 
the average of e~^ w will be the same over, say, any of the three distributions shown in Fig|| 
and will equal e~ ,3AF . 

Eq.^| relates the free energy difference between two equilibrium states of a system, to 
the work performed in reversibly taking the system from one state to the other. Eq.|^ is 
the extension of this statement to irreversible (nonequilibrium) processes. Note that, since 
AF depends only on the equilibrium states A and B, Eq.^ implies that the reversible work 
performed in going from A to B is independent of the path taken from A^ to A# in parameter 
space. (We have imagined only a single parameter A, but of course more generally parameter 
space can be multi-dimensional.) Eq|| makes a comparable statement as regards the rate at 
which we switch A: it says that the ensemble average of e~^ w is independent, not only of 
the path from A^ to A#, but also of how quickly or slowly we vary A along that path. 

Eq.|] gives the relationship between a quantity defined with respect to equilibrium states 
of a system (AF) to a quantity extracted from an ensemble of nonequilibrium processes. 
Moreover, this relationship takes the form of an equality, whereas most statements relating 
equilibrium and nonequilibrium quantities are expressed as inequalities, for instance, Eq.^. 
Indeed, as I have pointed out elsewhere 0, the inequality W > AF follows immediately 
and rigorously from Eq.|| 
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As a quick consistency check, we can verify the validity of Eq.[| in two limiting cases: 
infinitely slow (t s — > oo) and infinitely fast (t s — > 0) switching. In the former case, we get 
p — > 5{W — AF), and Eq.[| is satisfied. For t s — > 0, as discussed elsewhere 0, Eq.|] reduces 
to the following well-known identity: 

(exp -p AH) A = exp —(3AF, (6) 

where AH = Hb — Ha is the difference between the initial and final Hamiltonians, and 
(• • -)a defines a canonical average over the initial equilibrium state. 

A proof of Eq.|5|, based on a treatment in which both the system of interest and the 
heat reservoir are explicitly taken into consideration, was given in Ref. ||. Another proof, 
based on a master equation approach, was given in Ref. || , along with supporting numerical 
results. Yet a third proof, assuming Markovian evolution and microscopic reversibility (and 
which along the way yields an interesting detailed balance relationship for multiple time-step 
processes), has been found by Gavin Crooks [[|. 

In the spirit of this Symposium, I will sketch a proof of Eq.|5] for the case in which 
the evolution of the system of interest is modelled by a Langevin equation in configuration 
space, thus a statistical ensemble of such systems evolves under a Smoluchowski equation. 
(Physically, this corresponds to the limit of overdamped evolution, in which the momentum 
of the system reaches equilibrium with the heat reservoir on a time scale very short compared 
both to that required for the configuration of the system to equilibrate, and to the time r 
over which we perform the switching.) Although this case is a particular example of the 
situation considered in Ref. |3|], the proof presented here is different from those of Refs. 

Let us assume that the Hamiltonian for our system has the form H\(x,p) = p 2 /2m + 
V\(x). (Although we assume a one-dimensional configuration space, the generalization to 
more degrees of freedom is straightforward.) The free energy difference may then be ex- 
pressed in terms of a ratio of configurational partition functions: 

AF = -P~ 1 \n^- (7) 

Qa 

Qx = J dx exp — (3V\{x). (8) 

(I will often use A and B in place of Xa and Xb, respectively.) Let us now take the evolution 
of the configuration of the system to obey a Langevin equation: 

x = v x (x) + u(t), (9) 

where u(t) is a term representing white noise, 

(u(t)u(t + s)} = D5(s), (10) 

with (• ■ ■) denoting an average over realizations of the noise; and v\(x) is the terminal velocity 
attained by a particle subject to both a conservative force —dV\/dx, and a frictional force 
— 7X satisfying the Einstein relation, 7 _1 = (3D/2: 

= (ID 
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In Eq.^|, the external parameter depends on time, according to 



X(t) = X A + (X B - X A )t/r. (12) 

A stochastic trajectory x(t), t G [0, r], satisfying Eq.|9], represents the evolution of our 
system during a single realization of the switching process. We will now make use of the 
fact that, for such evolution, one can write down an explicit expression for the probability 
distribution of trajectories x(t). Namely, given an initial condition x(0) = xq, the probability 
for obtaining a particular trajectory x(t), as we switch A from A to B, is given by: || 

P A ->B[x(t)}=Nexp-S + [x(t)} (13) 

s±[x{t)] = ^Dlo dt ^ ± ir 9 ^) 2 ' (14) 

where X = X(t) in the integrand of Eq.[L4]. (I will make use of S- shortly.) The normalization 
factor M is chosen so that the integral of Pa-^b over all trajectories x(t), t e [0, r], starting 
from x(0) = Xo, is unity: 

Jv [x(t)]P A ^ B [x(t)] = l. (15) 
[The subscript on D indicates that we are integrating over paths x(t) with a fixed initial 

point, x(0) = Xq] 

To make sense of Eqs.|13| to 15, we must introduce a measure on path space. We do this 
by dividing the interval [0, r] into sub-intervals of duration 5t = r/N, then replacing the 
continuous trajectory x(t) by the discrete set of configurations x n = x{t n ) at times t n = n8t 
(n — 0, 1, • • - , N), and at the end taking the limit iV — ► oo. A convenient representation of 
the integral in Eq.0 is then: 



S±\m ^ E St [ Xn £=± ± ^d x V x {x u )] 2 , v = (16) 



2D^[ L st 2 



In Eq.|15| ; the integral in path space, over all trajectories x(t) with a fixed initial point 

x(0) = xo, is expressed as: 

N 

V [x(t)]---=H dx n ---. (17) 

J n=l J 

It is straightforward to verify that the normalization constant in Eq.|13| is given by M = 
(27iD5t)~ N / 2 , in this scheme. For future use, let us also define JV T [x(t)] = YI^q 1 J dx n , 
representing an integral over trajectories x(t) with a common final point x T = x(t) = x^. 
Note that 



/ dx J V [x(t)} ■■■ = Jdxrj V T [x{t)] = 1] Jdx n ---. (18) 

n=0 

For a particular trajectory x(t), the external work performed on the system is: 

W[x{t)]= dtXd x V x (x{t)). (19) 
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If we now launch an ensemble of such trajectories, from a canonical ensemble of initial 
conditions (corresponding to A = A) at t = 0, then an explicit expression for the average of 
e -pw over statistical ensemble is given by: 

exp —f3W = f dx — exp -(3V A (x ) [v [x(t)]j\f exp-S + [x(t)} exp-/3W[x(t)}. (20) 
J Q A J 

The first integral defines the distribution of initial conditions xq, the integral / T>q Ne~ s+ ■ ■ ■ 
is over all trajectories launched from a given point xo, each weighted by its probability 
(Eq.|13D, and e~^ w is the quantity being averaged. Now, from the definitions of S± and W 
we have: 

S + - S- + PW = (3 [ T dt (xd x V x + \d\V\) 
Jo 

= P&V, (21) 

where 

AV = V B (x T )-V A (x ). (22) 
With Eq.^, this allows us to rewrite Eq.|2y as 

exp -PW = — f dx T exp-[3V B (x T ) f V T [x(t))j\f exp -S-[x(t)). (23) 

The second integral on the right is unity: J T> T J\fe~ s ~ = 1. (While this may be verified 
explicitly, it also offers a nice interpretation: if we start in a configuration x T and switch A 
from B to A, then Ne~ s ~ is the normalized probability of observing the "reverse" of the 
trajectory x(t), i.e. a trajectory which starts at x T and "evolves backwards", ending at x .) 
Then, using Qb — I dx e~^ VB<yX \ we finally get 

exp -(3W = ^ = exp -/3AF. (24) 
Qa 

Q.E.D. 

I have just sketched a proof of Eq.[5] for the special case in which the evolution of the 
system of interest is modelled by a Langevin equation in configuration space. In this proof, 
an expression for the work W performed on the system, Eq.|l9|, was introduced without 
elaboration. More generally, the work is given by 

W= f dtXd x H x , (25) 

J 

where H\ is the parameter-dependent Hamiltonian for the system of interest, and d\H\ in 
the integrand is evaluated along a trajectory z(£) describing the evolution of the phase space 
coordinates of the system. For Hamiltonians of the form H\ = p 2 /2m + V\(x), Eq.^ reduces 
to Eq.fOl Let me now make a few comments regarding the origin of Eq.ER 
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The external work performed on an isolated system is equal to the net change in its 
energy. When that work is performed by the variation of an external parameter, we get 



W = H B (z T ) - H A (z 

= jT dt\d x H x (z(t)), (26) 

assuming a phase space trajectory z(t) evolving under Hamilton's equations, so that dH/ dt = 
dH/ dt || . Eq.^5] is therefore the correct expression for work, provided the system is isolated 
during the switching process. 

When the system of interest is coupled to a heat reservoir, then we may treat the two 
together as a larger, isolated system governed by a Hamiltonian of the form 

W A (z, z!) = H x (z) + H res {z') + h int (z, z'). (27) 

Here, z' represents a point in the phase space of the reservoir, H res is a Hamiltonian for 
the reservoir alone, and h int is a term which weakly couples the system of interest to the 
reservoir. Since the system of interest and reservoir together constitute a larger, isolated 
system, we may again use Eqj2^ for the external work performed, but with H x replaced by 
7i\. However, d x TL x {z,z') = d x H x (z), so we again end up with Eq.|25|. Q Note that the 
work W no longer represents the net change in the energy of the system of interest itself, 
W 7^ H B {z T ) — Ha(z ), but rather the net change in the total energy of system and reservoir. 

Finally, it is good to keep in mind that the concept of an external parameter is itself an 
idealization. In reality, such a "parameter" must actually be a degree of freedom — subject 
to back reaction forces — and the work performed by it, over some length of time, is simply 
the net loss in its energy. The idealization lies in assuming an infinite inertia for this degree 
of freedom. To illustrate these points, consider a Hamiltonian 

G(\,P x ,z,z') = ^ + H x (z,z>), (28) 

where A now represents the degree of freedom which was previously viewed as an external 
parameter, and M and Pa denote the associated inertia and momentum, respectively. The 
first term on the right represents the energy of the parametric degree of freedom; the second, 
as before, is the Hamiltonian for the coupled system of interest and reservoir. Hamilton's 
equations give 

A = |^ = - (29) 
dP\ M K ' 

BC 

Px = = -d x H x (z, z') = -d x H x {z). (30) 



2 In writing Eq.^7], I was careful to make only the first term on the right depend on A. Otherwise, 
by externally changing A, we would perform work directly on the degrees of freedom of the reservoir, 
a situation different from that considered in this talk. 
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From these we obtain the following expression for the rate of change of the energy of the 
"parameter" : 



£ = (31) 

from which, taking W to be minus the change in P%/2M, we once again get 



o 



W= / dt\d x H x (z(t)). (32) 



Note that now the time-dependence of A is not exactly that given by Eq.|T^, but rather 
is determined from Hamilton's equations. If, however, we consider the initial conditions 
A(0) = Xa and A(0) = (A# — \a)/t, and we take the limit M — ► oo, then over any finite 



time interval r we will get (see Eqs.|2£] and |30]) 



thus recovering Eq.|l^ for the evolution of A. 

In the preceding discussion, I have argued that Eq.^ (which in turn implies Eq.[T9| 
when H\ = p 2 /2m + V\) is the correct expression for the work performed on a system by 
the variation of an external parameter, both when the system is isolated and when it is 
coupled to a heat reservoir, and also when the external parameter is treated honestly as a 
degree of freedom (but in the limit of infinite inertia). This discussion can be illustrated 
by considering the example of a closed container filled with gas, where one wall of the 
container is free to move in and out as a piston. Let A denote the position of the piston, 
and z = (x 1; Pi, • • • , x^r, Pjv) the positions and momenta of the TV individual gas molecules. 

When we externally move the piston at some finite rate from a position A = A to another 
position A = B, we perform a quantity of work each time a gas molecule scatters off the 
moving wall; that work is just the change in the kinetic energy of the molecule during the 
collision. If the container is isolated, then this is the only mechanism by which the energy of 
the gas can change, so at the end of the switching process the work performed is equal to the 
change in the internal energy of the gas. It is a straightforward exercise |7j to show explicitly 
(without invoking the Hamiltonian identity dH/ dt = dH/ dt) that the change in the energy 
of the gas, during a given collision between a molecule and the moving wall, is equal to the 
time integral of \d\H\ along the trajectory z(t) describing the phase space evolution of the 
gas, from a time immediately before to a time immediately after the collision. The total 
change in energy (and therefore the work performed) over some finite period of time is then 
just the integral of \d\H\ along z(t), over that span of time. 

Now imagine that the wall of the container opposite to the piston is externally maintained 
at some temperature T. Then there exist two mechanisms by which the energy of the gas 
changes: by the scattering of a molecule off the moving piston, as above, and by the scattering 
of a molecule off the thermostatted wall. As before, the net contribution of the former is 
the time integral of \d\H\ (even though the trajectory z(t) is no longer Hamiltonian). It is 
only this contribution which counts as work performed on the gas: the sum of all the energy 
changes due to collisions with the thermostatted wall is the heat absorbed or relinquished 
by the gas. Thus we again obtain Eq.|25|. 
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Finally, suppose the piston is itself a massive object, moving frictionlessly from A to B, 
rather than an externally pushed device. As before, work is performed by the piston every 
time a molecule scatters off it (and again the total work is given by the integral of \d\H\), 
but now the kinetic energy of the piston changes at each such collision. If the piston begins 
with a speed Ao, and is then observed for a time r, then the final speed will be 

A T = x/Ag - 2W/M, (34) 

M being the mass of the piston. For any set of initial conditions of the gas, we get A T — > A 
in the limit M —>■ oo, so in that limit the speed of the piston remains constant, just as if 
it were being driven externally. (In other words, for an infinitely massive piston, the work 
performed by it on the gas represents an infinitesimal proportional change in the piston's 
kinetic energy.) 

CONCLUSIONS 

The focus of this talk has been a result (Eq.|5|) which may be viewed as an extension — to 
irreversible, nonequilibrium processes — of the well-known relationship between reversible 
work and free energy (Eq.0). Just as the reversible work performed in parametrically switch- 
ing a system from A to B is equal to AF regardless of the path taken in parameter space, 
so the average exp —(3W - - defined with respect to a statistical ensemble of irreversible 
processes — is equal to exp — (3AF regardless of both the path taken, and the rate at which 
the switching is carried out. After presenting this result, I have sketched a proof for the 
special case when the system evolves under a Langevin equation in configuration space. I 
have also discussed the general expression for the work performed on the system (Eq.p5|). 
in terms of a phase space trajectory z(t) describing the evolution of the micro-state of the 
system. 
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FIGURES 



FIG. 1. The unique macroscopic equilibrium state corresponding to a temperature T, and 
a value of the external parameter A, may be represented by a point in the (A, T)-plane. By 
keeping the system thermostatted at a constant temperature, and changing the external parameter 
quasistatically, we can reversibly switch the system from one equilibrium state, A, to another, B. 

FIG. 2. If we start with the system in equilibrium state A, but then switch the external param- 
eter from Xa to Xb at a finite rate, the system will progress through a sequence of nonequilibrium 
states, indicated schematically by the shaded region. 

FIG. 3. The distribution of values of work, p(W), performed during a statistical ensemble 
of switching processes, depends on the switching time r. For r — > oo this distribution becomes 
a 5-function at W = AF. Generically, one expects a broader distribution, the more rapidly the 
switching is performed. 
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